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In June 1994 I gave a five-day course on the limits of mathematics at 
the University of Maine in Orono. This course featured a new approach 
to algorithmic information theory (AIT). Four versions [l]-[4] of the 
course notes for this course, each using a somewhat different approach, 
are available. To automatically obtain any one of them in ETgK, for ex- 
ample |chao-dyn/94070(J5 , send e-mail to "chao-dyn @ xyz . lanl . gov" 



ctf 



with "Subject: get 9407003". 

AIT deals with program-size complexity. I define the complexity 
H(X) of an object X to be the size in bits of the smallest program 
that can calculate X. Up to now, to get elegant mathematical prop- 
erties for this complexity measure H(X), I had to measure the size 
of programs for an abstract universal Turing machine. This gave the 
right mathematical properties, but it was not a programming language 
that anyone could actually use. Now I have found a way to obtain 
the correct program-size complexity measure of AIT by measuring the 



size of programs in a series of powerful and easy to use programming 
languages. These programming languages are versions of LISP that I 
have invented expressly for this purpose. Which of these programming 
languages one considers most natural is to a certain extent a matter of 
personal taste. 

What does AIT have to say concerning the limits of mathematics? 
My theory yields two fundamental information-theoretic incomplete- 
ness theorems. First of all, my theorem, originally going back to 1970, 
that an iV-bit formal axiomatic system cannot enable one to exhibit 
any specific object X with program-size complexity H(X) greater than 
N + c. Secondly, my theorem, originally going back to 1986, that an N- 
bit formal axiomatic system cannot enable one to determine more than 
N + c' scattered bits of the halting probability Q. In |chao-dyn/940700~3" 



c = 2359 bits and d = 7581 bits. In |chao-dyn/9407005| , c = 1127 bits 



and d = 3689 bits. In |chao-dyn/94U7UU6| , c = 994 bits and d = 3192 



bits. And in |chao-dyn/9407009| , c = 735 bits and d = 2933 bits. 



I think I prefer the "aggressive" formulation in |chao-dyn/9407009 



I can also make a case for the "conservative" formulation in |chao- 



dyn/ 9407003| . |chao-dyn/9407005| and |chao-dyn/9407006| are the inter- 



mediate steps between |chao-dyn/9407003| and |chao-dyn/ 9407009 



After the references we summarize |chao-dyn/940700~3| in a four-page 



appendix. The first page is a table summarizing the version of LISP 
that is used. The second page is an example of a program written in 
this LISP. The third page summarizes the definitions, and the fourth 
page summarizes the results. 
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quote 


1 arg 


'(abc) — > (abc) 


+ 


head 


1 arg 


+'(abc) — ► a 

~\~8b ^ 8b 


" 


tail 


1 arg 


-'(abc) — > (be) 

8, ^ 8, 


* 


join 


2 args 


*a'(bc) — ► (abc) 

clD ^ 8b 




atom 


1 arg 


.a — > 1 
.'(a) — ► 


= 


equal 


2 args 


=ab — ► 


/ 


if 


3 args 


/Oab — > b 
/xab — > a 


& 


function 


2 args 


('&(xy)y ab) — > b 


J 


display 


1 arg 


,x — > x and displays x 


I 


eval 


1 arg 


!e — > evaluate e 


? 


try 


3 args 


?teb — >■ evaluate e time t with bits b 

| ? captured | 
' e ~" { (value) di8playS - • • ) 


@ 


read bit 


args 


@ — > or 1 


% 


read exp 


args 


% — > any s-expression 


# 


bits for 


1 arg 


T^x — > bit string for x 


" 


append 


2 args 


-'(ab)'(cd) — > (abed) 


"" 


show 


1 arg 


~x — > x and may show x 




let 


3 args 


:xv e — ► ('&(x)e v) 

:(fx)d e — > ('&(f)e '&(x)d) 


& 


define 


2 args 


&xv — > x is v 
&(fx)d — > fis&(x)d 


» 


literally 


1 arg 


"+^ + 


{} 


unary 




{3} — (111) 


[] 


comment 




[ignored] 





empty 









false 






1 


true 
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lisp.c 

LISP Interpreter Run 

[[[(Fx) = flatten x by removing all interior parentheses]]] 
[Define F of x as follows: if x is empty then return empty, if 
x is an atom then join x to the empty list, otherwise split 
x into its head and tail, flatten each, and append the results.] 
& (Fx) /=x()() /.x*x() ~(F+x)(F-x) 

F: (&(x)(/(=x()) ()(/(. x)(*x())r(F(+x))(F(-x)))))) 

(F,F) [use F to flatten itself] 

expression (F(,F)) 

display (&(x)(/(=x()) ()(/(. x)(*x())(~(F(+x))(F(-x)))))) 

value (&x/=x/.x*x~F+xF-x) 

[[[(Gx) = size of x in unary]]] 

[Let G of x be [if x is empty, then unary two, if x is an atom, 

then unary one, otherwise split x into its head and tail, 

size each, and add the results] in ...] 
: (Gx) /=x()'{2} /.x'{l} ~(G+x)(G-x) 
[Let G of x be [. . .] in:] 
(G,G) [apply G to itself] 

expression (( ' (&(G) (G(,G)))) (' (&(x) (/(=x()) ( ' (11)) (/( .x) ( ' (1) 

)(~(G(+x))(G(-x)))))))) 
display (&(x)(/(=x())('(ll))(/(.x)('(l))C(G(+x))(G(-x)))) 

)) 
value (1111111111111111111111111111111111111111111111111 

111) 

End of LISP Run 

Elapsed time is seconds. 



DEFINITIONS 



An S-expression x is elegant if no smaller S-expression has the 
same output. (Here "output" may be either its value or what it 
displays.) 

Let x be an S-expression. The LISP complexity Hl(x) of x is the 
size in characters \p\ of the smallest S-expression p whose value is 
x. 

Let X be an infinite set of S-expressions. The LISP complexity 
Hl(X) of the infinite set X is the size in characters \p\ of the 
smallest S-expression p that displays the elements of X. 

[U(p) = output of universal machine U] 
[ given binary program p. ] 

& (Up) ++?0 ' ! °/ p 

Let x be an S-expression. The complexity H(x) of x is the small- 
est possible value of 7 times (the size in characters \p\ of an S- 
expression p whose value is x if it is given the binary data d) plus 
(the size in bits \d\ of the binary data d given to p). 

Equivalently H(x) = Hu{x) is the size in bits \p\ of the smallest 
bit string p such that U(p) = x. 

The halting probability Q of U is the limit as t — ► oo of (the 
number of i-bit programs p such that U(p) halts within time t) 
divided by 2*. 

Let X be an infinite set of S-expressions. The complexity H(X) of 
the infinite set X is the smallest possible value of 7 times (the size 
in characters \p\ of an S-expression p that displays the elements 
of X if it is given the binary data d) plus (the size in bits \d\ of 
the binary data d given to p) . 

Equivalently H(X) = Hjj{X) is the size in bits \p\ of the smallest 
bit string p such that X = lim^oo -?t ' ! °/„p . 
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RESULTS 

• Lowcase variables x, y, n are individual S-expressions. 
Uppercase variables X, Y, T are infinite sets of S-expressions. 

• H L (x,y)<H L (x)+H L (y) + 8. 

• If x E T ==>- x is elegant, then 
x e T => \x\ < H L (T) + 378. 

• If (x, n) G T =>- Hl(x) > n, then 
(x, n) E T =>• n < H L (T) + 381. 

• H(x, y) < H(x) + H(y) + 140. 

• Let x be a string of \x\ bits. 

if (a;) < 2\x\ + 469, and H(x) < \x\ + ff(|x|) + 1148. 

• Let Q n be the first n bits of Q. 
H(n n ) >n- 4431. 

• H(x n y) < # (x) + if (y) + 4193. 

• /f (x u y) < ff (x) + if(y) + 4193. 

• If (x, n) ET ==>- H(x) > n, then 
( x ,n)eT^n< H(T) + 2359. 

• T cannot determine more than H(T) + 7581 bits of Q. 



